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Abstract 



We present results of extensive bit level tests on some pseudorandom 
number generators which are commonly used in physics applications. The 
generators have first been tested with an extended version of the rf-tuple test. 
Second, we have developed a novel cluster test where a physical analogy of 
the binary numbers with the two dimensional Ising model has been utilized. 
We demonstrate that the new test is rather powerful in finding periodic 
correlations on bit level. Results of both test methods are presented for each 
bit of the output of the generators. Some generators exhibit clear bit level 
correlations but wc find no evidence of discernible correlations for generators, 
which have recently produced systematic errors in Monte Carlo simulations. 



PACS numbers: 02.70.Lq, 05.50.+q, 75.40Mg. 



Vast amounts of random numbers are needed in several applications 
such as stochastic optimization and Monte Carlo simulations [0. Modern 
high speed computers have set rigorous demands for the quality of random 
numbers, which are usually produced by pseudorandom number generator 
algorithms. A prerequisite to the success of the methods is the quality of 
randomness of the output of the generators. It is usually determined by 
statistical tests f^. Usually many such tests are needed, since there is no 
unique recipe for determining when a given sequence is "random enough" . 

Unfortunately, even comprehensive statistical testing cannot guarantee 
that a given random number generator is reliable for all applications. In fact, 
tests are needed which would be more physical, based on the use of gener- 
ators in solving actual physical problems. A few such application specific 
tests have been performed ^, 0. In particular, intriguing results have 
been reported by Ferrenberg et al. who employed some of the most com- 
monly used random number generators in simulations of the two dimensional 
Ising model at criticality. When using the Wolff algorithm they reported 
anomalously large errors with a particular generator, called R250. The same 
conclusion has been drawn from simulations of self-avoiding random walks 
10[| , where also other similar generators failed. 

Although there have been prior warnings against the use of shift register 
generators such as R250 [|lT], [l^, the results of Refs. p], |lOl are surprising 
since recent extensive statistical tests have found no discernible correlations 
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in R250 |T^. In Ref. g|, the authors suggest that bit level correlations in 
the most significant bits of R250 may be responsible for their results. If true, 
this casts serious doubt on the bit level reliability of R250. More and also 
better tests are then needed to resolve the issue. 

The purpose of the present work is to study bit level correlations in 
some commonly used generators in more detail. To this end we have first 
extended the rf-tuple test [T^ to more efficiently find correlations. Second, 
we have developed a new physical duster test which is based on an analogy 
to the Ising model. The test is implemented on bit level and its effectiveness 
compared with the d-tup\e test. We demonstrate that the cluster test is 
particularly powerful in finding periodic correlations. Both the d-tuple and 
the cluster tests are then applied to each bit of a number of generators. 



including some of the shift register generators in Refs. Our results 

demonstrate that no discernible bit level correlations can be found in the 
shift register generators with the present test methods. 

The pseudorandom number generators used here include two linear con- 
gruential generators, LCG(16807,0,23i-l) |1§ known as GGL (CONG in Ref. 
§), and LCG(69069, 1,232) |g implemented as RAND Additionally, 
RAN3 is a LF(55,24,— ) based on a Lagged Fibonacci algorithm, whereas 
RANMAR ig is a combination generator. Finally, GFSR(250,103,©) 
and GFSR(1279,216,©) are generalized feedback shift register generators 
known as R250 ^ and R1279, respectively. The details of the algo- 
rithms can be found, for example, in Ref. JT3|. We note that the generators 
were implemented to produce integers except for RANMAR, whose 24 bit 
reals were multiplied by 2'^^ — 1. Initial seed values were chosen from the set 



2 



{14159,667790,1415926535,95141}, excluding R250 and R1279 which were 
initiahzed with GGL in double precision accuracy. 

The (i-tuple test is based on studying the properties of random numbers 



on bit level [|T2|. Our realization follows Ref. [|1^]. The main difference here 
is the improvement to calculate the x^-distributed test statistics a total of 
N times and submit their empirical distribution to a Kolmogorov - Smirnov 
(KS) test. The final test variables are therefore the values and of a 
KS - test statistic -ft' [§]. In each test the sequence of bits was considered to 
fail if the observed descriptive level 6 = P{K < {K~^, K^}\Ho) was less than 
0.05 or larger than 0.95. 



Based on previous work |T3[ the li-tuple test seems to find correlations 
more efficiently than the rank test [0, |12|, for example. In order to deter- 
mine the quantitative effectiveness of the test we have first studied its ability 
to observe correlations inserted into the output of GGL, which passes the 
standard bit tests |T^. The correlations have been inserted periodically by 
setting the i*^ bit (i = 1, 2, . . . , 31) of every number always equal to one. 
By systematically varying ^, we can then find the maximum approximate 
distance C,c within which the ci-tuple test can detect periodic correlations. 
The test was repeated three times with parameters d = t = 3, n = 5000 and 



= 1000, where d and t are taken from Refs. ||13| , p!4| and n is the number 
of samples in a single - test. The results are shown in Table 1, where 
the parameter p gives the probability of observing correlations. Thus, the 
d-tuple test can always detect periodic correlations up to C,c ~ 43 bits apart. 
The same test was repeated with d = 9 and t = 1 to consider single bits only, 
which gave ~ 50. We also note that we performed similar systematic tests 
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for the rank test, which was found to be inferior to the (i-tuple test. 

To improve the detection range of the ci-tuple test we have performed its 
extended version. This can be reahzed by testing bits from every k^^ number 
and then testing all k such subsequences. This way all periodic correlations 
may be detected up to about k x (assuming k < ^c)- We have applied 
this extended test to GGL, R250, R1279, and RAN3, which were all tested 
twice. The results are summarized in Table 2. The most remarkable result is 
that up to A; = 20, which corresponds to a distance of about 860 bits apart, 
no discernible correlations were observed for the 16 most significant bits of 
either R250 or R1279. In addition, we tested R250 with k = 50, k = 100 and 
k = 1000 where only one subsequence was studied in each case. No evidence 
of correlations was found. This result is in contrast with Ref. [0, where 
it was estimated that for R250 a typical range of correlations is about 400. 
However, when initialized with RAN3 which itself contains correlated bits, 
both R250 and R1279 display clear bit level correlations, although the longer 
feedback of R1279 seems to be less sensitive to initial correlations. 

There is a natural analogy between binary numbers and the Ising model, 
which can be made use of in constructing a new physical cluster test in the 
following way. We take i^^ bit from every successive number and put them 
on a two dimensional lattice of size L^. By identifying zeros and ones with 
the "down" and "up" spins of the Ising model, the resulting configuration — 
if truly random — should be one of the 2^^ equally weighted configurations 
corresponding to infinite temperature. The easiest quantity that one can 
then compute from this analogy is the magnetization. However, a better 
measure of spatial correlations can be obtained if we study the distribution 
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of connected spins, or clusters of size s on the lattice. The cluster size 
distribution (ra^) is given by 

(n,) = sp'DM, (1) 

where Ds{p)^s are polynomials in p = 1/2. The normalization condition is 
J^'^ii'iT-s) = 1- Enumeration of the polynomials Ds{p) has been done up to 



s = 17 22 



The test procedure we have used is as follows. We first form a lattice 
as above and enumerate all the clusters in it. For such a configuration we 
calculate the (unnormalized) average size of clusters within s = 1, 2, . . . , 17, 
denoted as S[y\ This procedure is repeated M times corresponding to con- 
figurational averaging, yielding = Ek=iSi7/M. The theoretical coun- 
terpart of this quantity is given by Su = Y^lLi s{ns). We also compute the 
empirical standard deviation an of the quantities 5*^7^ For each i^^ bit the 
test statistic chosen in this work is: 

9i = • (2) 

(Ti7 

Using this statistic, tests were performed comparatively between several pseu- 
dorandom number generators, with results from GGL assumed to be inde- 



pendent variables p3[. Therefore, the mean value of gi over all the 31 bits of 
GGL, denoted as gcGL and the corresponding standard deviation ctggl were 
computed and the results for all other generators were compared with these 
values using 

9i = • (3) 

<^GGL 

The bit i in question failed the test if was greater than three. We also 



considered other similar choices for the test parameters and criteria and 
obtained consistent results. 

The effectiveness of the cluster test was first scrutinized by inserting 
periodic correlations as in the case of the (i-tuple test. We chose L = 200, 
M = 10000 and the study was repeated for all values of ^ = 1, 2, . . . , L. The 
results are shown in Table 3, where filled squares denote distances where 
correlations were detected. With this choice of parameters the cluster test 
is able to find all periodic correlations up to ~ 60. This shows that the 
cluster test performs somewhat better than either the ci-tuple or rank tests. 

Next, we have subjected each bit of the random number generators 
to the cluster test. It was repeated twice with parameters L = 200, and 
M = 10000. Additional tests with L = 500 gave consistent results. Results 
are summarized in Table 4, where also results of the previous rf-tuple and 



rank tests from Ref. have been included. Although more powerful than 
the other methods, the cluster test still reveals no discernible correlations 
for either GGL, R250 or R1279. For RANMAR and RAN3, the cluster test 
gives results consistent with Ref. |]13[, but for RAND additional correlations 
are revealed in bits 8 - 12, which passed the ci-tuple test. 

For completeness, we also tested the distribution of bits. The bits 
failed the test if the deviation from the expected number of ones (i.e. 
consequtively exceeded three times the standard deviation of the binomial 
distribution with M samples. The test was repeated twice with M = 4 x 10^ 
and its results are also shown in Table 4. No correlations were found for GGL, 
R250, or R1279. Surprisingly, however, this rather simple test revealed that 
the first 11 bits of RAN3 fail (with standard deviations larger than 6.7) 
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although only the first four or five bits fail in the other tests. This signals 
correlations in these additional bits. On the other hand, for RAND only bits 
22-31 failed, which produced an exact 50 - 50 distribution of zeros and ones. 

In conclusion, we have performed extensive bit level tests of several 
commonly used pseudorandom number generators, including R250 which 
had been suggested to contain bit level correlations [Q. To this end, we 
have performed an extended version of the d-tuple test, and developed a 
novel physical cluster test, which is rather powerful in finding periodic cor- 
relations. Our results reveal significant bit level correlations in some genera- 
tors, such as RAN3 and RAND, but absolutely no discernible correlations in 
GGL, R250, or R1279. Thus, our results show that these generators should 
be good enough for many applications, where good bit level properties are 
required. However, we note that it is still of crucial importance to further 
develop physical tests along the lines presented here to detect more subtle 
correlations, which may not be revealed by the present test methods. 



7 



Table Captions 

Table 1. Results of the d-tup\e test with inserted correlations in the bits, 
with a period of ^. The probability for the test to observe correlations is 
denoted by p, which equals one up to ~ 43. 

Table 2. Results of the extended d-tuple tests, k denotes the extended range 
of the tests. See text for details. 

Table 3. Results of the cluster test with correlations in the bits, with a period 
of ^ from one to 200. Black squares denote corresponding distances at which 
correlations were found as explained in the text. 

Table 4. Results of the cluster test. c?-tuple and rank test results are from 



Ref. [T^. The last column denotes bits which fail in testing the distribution 



of ones. 
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40 


43 


52 


60 


70 


80 


90 


100 


110 


120 


p 


1.000 


0.889 


0.778 


0.333 


0.667 


0.222 


0.333 


0.111 


0.222 


0.000 



Table 1: 



Random 




Failing bits 




number 


k 


in the 


Comments 


generator 




d-tuple test 




GGL 


1,5 


none 


double precision mode 








(return integers) 


R250 


1,5 


none 


integer mode, initialized 








with GGL in double precision 


R250 


20 


none 


only 16 most significant 








bits were studied 


R1279 


1,5 


none 


integer mode, initialized 








with GGL in double precision 


R1279 


20 


none 


only 16 most significant 








bits were studied 


RAN3 


1 


1-5, 25-30 


integer mode 


R250 


1 


1 - 2, 27- 31 


integer mode, initialized 








with RAN3 producing integers 


R1279 


1 


1 


integer mode, initialized 








with RAN3 producing integers 



Table 2: 
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Table 3: 
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Random 


Failing bits 


number 


Cluster test 


rf-tuple test 


Rank test 


Distribution 


generator 








of l)its 


GGL 


none 


none 


none 


none 


R250 


none 


none 


none 


none 


R1279 


none 


none 


none 


none 


RANMAR 


25-31 


25-31 


25-31 


25-31 


RAN3 


1 - 4, 25 - 30 


1 - 5, 25 - 30 


1 - 5, 26 - 30 


1-11, 24-30 


RAND 


8-31 


13-31 


18-31 


22 - 31 



Table 4: 
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